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(54) System having an information processing apparatus and a data input apparatus, and 
method for controlling the system 



(57) When a shutter button of a camera is pressed, 
an application execution signal is transmitted from the 
camera to a computer which is connected to the cam- 
era. If an application corresponding to the application 
execution signal is not being executed, the computer 



FIG.1 



automatically executes the application which is stored in 
a hard disk in response to reception of the application 
execution signal. 
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Description 

BACKGROUND OF THE INVENTION 

The present invention relates to a system having an s 
information processing apparatus and a data input 
apparatus, and a method for controlling the system and, 
more particularly, to a system capable of automatically 
executing a predetermined application program in an 
information processing apparatus in accordance with an 10 
operation by a data input apparatus, and a method for 
controlling the system. 

Conventionally, in an image sensing system having 
an image sensing apparatus (data input apparatus), 
such as a CCD camera, a computer and a monitor, for 75 
executing an application program, such as a TV confer- 
ence and a TV phone application programs, a user dou- 
ble-clicks on an icon of the application displayed on the 
monitor or inputs a command via a keyboard. 

In the above conventional example, however, for 20 
executing a TV conference application program or a TV 
phone application program, for instance, the user has to 
operate the computer, e.g., search the desired icon and 
operate a mouse or input a command using the key- 
board. In this manner, the user has to operate both the 25 
image sensing apparatus and the computer; turn on the 
image sensing apparatus, and instruct the computer to 
execute a desired application program. 

Further, there is a demand for a camera capable of 
sensing a moving image of a person and landscape as 30 
well as a high-resolution stili image of a document, for 
example, as an image sensing device to be used in the 
TV conference system and the TV phone system. 

In response, as an image sensing apparatus for a 
TV conference system or a TV phone, a computer cam- 35 
era having a document mode (for inputting a document 
in high resolution) and a non-document mode (for input- 
ting a still image and a moving image in general) and 
capable of performing bidirectional communication with 
a personal computer is on the market. Such a camera 40 
senses a person and landscape, for instance, in the 
non-document mode, whereas, senses a document 
which is often written in monochromatic color in the doc- 
ument mode. 

A few examples of the document modes and the 45 
non-document modes are briefly explained below. In 
one image sensing apparatus, normal color processing 
is performed in the non-document mode, whereas 
mono-chromatic processing is performed in the docu- 
ment mode. Further, an image sensing apparatus capa- so 
ble of performing so-called pixel shifting operation for 
obtaining a single high-resolution image by synthesizing 
a plurality of images sensed in a lower resolution while 
shifting image formation position on an image sensing 
device, such as a CCD, is available. Camera operation 55 
and image processing as in a common video camera 
are performed without performing the pixel shifting 
operation in the non-document mode, whereas a high- , 



resolution image is obtained by performing pixel shifting 
operation using a plane parallel plate, for instance, in 
the document mode. 

When a document is sensed in the document 
mode, possible ways of using the sensed image of the 
document are as follows. 

(1) Sensed image file is generated as images are 
obtained. 

(2) An application for processing the document of 
the sensed image is executed. For example, an 
optical character recognition reader (OCR) soft- 
ware is applied to the document image to obtain a 
text file. 

When applicability and convenience are consid- 
ered, the processing (2) is often performed. A block dia- 
gram illustrating a brief configuration of a system 
capable of performing the processing (2) is shown in 
Fig. 13, and a flowchart of a typical operation of the sys- 
tem is shown in Fig. 14. 

In Fig. 13, reference numeral 1010 denotes a cam- 
era capable of operating in the document mode and the 
non-document mode; 1020, a personal computer; 1021 , 
a CPU; 1022, a RAM; 1023, a capture board for captur- 
ing an image sensed by the camera 1010; 1024, a con- 
troller for controlling the camera 1010 and the capture 
board 1023; 1025, a disk; 1026, an image file of the cap- 
tured image; 1027, a user interface (camera applica- 
tion) for controlling the camera or other units; 1028, an 
OCR software which is frequently used after capturing 
an image of a document; and 1030, a user. 

Next, a typical operation for capturing a document 
image is explained with reference to Figs. 13 and 14. 
First, the user 1 030 inputs a reguest to sense in the doc- 
ument mode [a"]. At this time, image sensing mode of 
the camera 1010 changes from the non-document 
mode to the document mode. Then, the user 1030 
inputs a request for capturing a sensed document 
image [b"], in turn, the document image is captured and 
stored as the image file 1026. Here, an operation for 
converting the document file 1026 into a text file using 
an OCR software is often performed. The user 1030 
executes the OCR software 1028 to convert the image 
file 1026 into a text file. 

As described above, after a document is sensed in 
the document mode, an application software for per- 
forming some processing on the document image is fre- 
quently executed. 

However, since control of the image input appara- 
tus (by camera application) which senses a document, 
and an application, such as an OCR software, operate 
independently, in general, it is necessary to initiate the 
latter application each time a document is sensed. 
Since an application, such as the OCR software, for 
processing a document image is frequently used after 
documents are sensed, the process for initiating the 
application each time is quite wasteful. 
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SUMMARY OF THE INVENTION 

The present invention has been made in considera- 
tion of the above situation, and has as its object to pro- 
vide a system, having an information processing 5 
apparatus and a data input apparatus, capable of auto- 
matically executing a predetermined application pro- 
gram in the information processing apparatus in 
response to an operation in the data input apparatus, 
and a method for controlling the system. 10 

According to the present invention, the foregoing 
object is attained by providing an image sensing appa- 
ratus capable of connecting to an information process- 
ing apparatus comprising: operation means; signal 
generation means for generating a predetermined sig- is 
nal used for requesting to execute a predetermined 
application in the information processing apparatus in 
response to an operation of the operation means; and 
communication means for sending the predetermined 
signal generated by the signal generation means exter- 20 
nally. 

According to the present invention, the foregoing 
object is also attained by providing a system having an 
information processing apparatus and a data input 
apparatus, said system comprising: operation means; 25 
signal generation means for generating a predeter- 
mined signal in response to an operation of the opera- 
tion means; communication means for transmitting the 
predetermined signal generated by the signal genera- 
tion means from the data input apparatus to the infor- 30 
mation processing apparatus; and control means for 
automatically executing a predetermined application in 
response to the predetermined signal transmitted via 
the communication means. 

Further, according to the present invention, the 35 
foregoing object is also attained by providing a method 
for controlling an information processing apparatus 
capable of connecting to an external data input appara- 
tus, said method comprising: a receiving step of receiv- 
ing a signal from the external data input apparatus; and 40 
a control step of executing a predetermined application 
when a predetermined signal is received in the receiv- 
ing step. 

Furthermore, according to the present invention, 
the foregoing object is also attained by providing a 45 
method for controlling a system having an information 
processing apparatus and a data input apparatus, the 
method comprising: a detecting step of detecting a pre- 
determined operation in the data input apparatus; a 
generating step of generating a predetermined signal so 
used for requesting to execute a predetermined applica- 
tion in the information processing apparatus when the 
predetermined operation is detected in the detecting 
step; a communication step of transmitting a predeter- 
mined signal from the data input apparatus to the infor- 55 
mation processing apparatus; and a control step of 
executing a predetermined application in the informa- 
tion processing apparatus on the basts of the predeter- 
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mined signal transmitted in the communication step. 

It is another object of the present invention to pro- 
vide a system, having an information processing appa- 
ratus and a data input apparatus, capable of 
automatically executing a predetermined application 
program in the information processing apparatus when 
the data input apparatus, capable of operating in a plu- 
rality of modes, starts operating in a predetermined 
mode, and a method for controlling the system. 

According to the present invention, the foregoing 
object is attained by providing an image sensing appa- 
ratus capable of operating in a plurality of operational 
modes and connecting to an information processing 
apparatus, comprising: signal generation means for 
generating a predetermined signal indicating that the 
image sensing apparatus starts operating in a predeter- 
mined mode; and communication means for sending 
the predetermined signal generated by the signal gen- 
eration means externally. 

According to the present invention, the foregoing 
object is also attained by providing a system having an 
information processing apparatus and a data input 
apparatus capable of operating in a plurality of opera- 
tional modes, said system comprising: control means 
for automatically executing a predetermined application 
corresponding to a predetermined operational mode out 
of the plurality of operational modes when the data input 
apparatus starts operating in the predetermined opera- 
tional mode. 

Further, according to the present invention, the 
foregoing object is also attained by providing a method 
for controlling an information processing apparatus 
capable of connecting to an external data input appara- 
tus capable of operating in a plurality of operational 
modes, said method comprising: a control step of auto- 
matically executing a predetermined application corre- 
sponding to a predetermined operational mode out of 
the plurality of operational modes when the external 
data input apparatus starts operating in the predeter- 
mined operational mode. 

Furthermore, according to the present invention, 
the foregoing object is also attained by providing a 
method for controlling a system having an information 
processing apparatus and a data input apparatus capa- 
ble of operating in a plurality of operational modes, said 
method comprising: a control step of automatically exe- 
cuting a predetermined application corresponding to a 
predetermined operational mode out of the plurality of 
operational modes when the data input apparatus starts 
operating in the predetermined operational mode. 

Other features and advantages of the present 
invention will be apparent from the following description 
taken in conjunction with the accompanying drawings, 
in which like reference characters designate the same 
or similar parts throughout the figures thereof. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorpo- 
rated in and constitute a part of the specification, illus- 
trate embodiments of the invention and, together with 
the description, serve to explain the principles of the 
invention. 

Fig. 1 is a block diagram illustrating a configuration 

of an image sensing system according to a first 

embodiment of the present invention; 

Fig. 2 is a block diagram illustrating a configuration 

of an image sensing system according to a first 

modification of the first embodiment of the present 

invention; 

Fig. 3 is a block diagram illustrating a configuration 
of an image sensing system according to a second 
modification of the first embodiment of the present 
invention; 

Fig. 4 is a block diagram illustrating a configuration 
of an image sensing system according to a third 
modification of the first embodiment of the present 
invention; 

Fig. 5 is a block diagram illustrating a configuration 
of an image sensing system according to a second 
embodiment of the present invention; 
Fig. 6 is an external view of the image sensing sys- 
tem according to the second embodiment of the 
present invention; 

Fig. 7 is an explanatory view showing an opera- 
tional sequence of the image sensing system 
according to the second embodiment of the present 
invention; 

Fig. 8 is a block diagram illustrating a configuration 
of a camera used in the image sensing system 
shown in Fig. 5; 

Fig. 9 is a block diagram illustrating another config- 
uration of a camera used in the image sensing sys- 
tem shown in Fig. 5; 

Fig. 10 is an explanatory view showing an opera- 
tional sequence of an image sensing system 
according to a third embodiment of the present 
invention; 

Fig. 1 1 a block diagram illustrating a configuration 
of a camera used in the image sensing system 
shown in Fig. 5 according to the third embodiment 
of the present invention; 

Fig. 12 a block diagram illustrating another configu- 
ration of a camera used in the image sensing sys- 
tem shown in Fig. 5 according to the third 
embodiment of the present invention; 
Fig. 1 3 is a block diagram illustrating a configuration 
of a conventional image sensing system; and 
Fig. 14 is an explanatory view showing an opera- 
tional sequence of the conventional image sensing 
system. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Preferred embodiments of the present invention will 
5 be described in detail in accordance with the accompa- 
nying drawings. 

Note, the present invention will be explained as an 
image sensing system, however, the present invention 
is not limited to the image sensing system and can be 
ic applied to a system comprising an information process- 
ing apparatus and a data input apparatus. Further, the 
present invention can be in a form of a storage medium 
storing a program realizing the effects of the present 
invention. 

is 

( First Embodiment > 



Fig. 1 is a block diagram illustrating a configuration 
of an image sensing system according to the first 
embodiment of the present invention. 

Referring to Fig. 1, the system comprises an image 
sensing apparatus 101, a computer (control apparatus) 
201, and a display apparatus 30. The image sensing 
apparatus 101 includes: an image sensing unit 13 for 
sensing an object and transmitting an image signal; a 
camera controller 12 for controlling the overall operation 
of the image sensing apparatus 101 ; an d a shutter but - 
ton 1 1 for switching the type of image dgrWj ransmitted 
Tromthe image sensing unit ia, from a moving image to 
ajsjhll Image. I he compuier zui includes: a mother 
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board 21 which is a main processing unit; an expansion 
slot 22; an expansion board 23 for connecting to the 
image sensing apparatus 101; and a hard disk 24 for 
storing an operating system, application programs, 
data, and so on. The display apparatus 30 displays an 
image sensed by the image sensing apparatus 101 and 
dialog of the application program being executed on the 
computer 201. 

Next, an operation of the image sensing system is 
explained. When the, shutter button 11 of the ima ge 
.se nsing apparatus 101 is pressed, the camera contro l- 
ler 12 detects the operation. In turn, the camera cont rol- 
ler 12 transmits an application execution rpq"ftfit sifl na! 
to the expansion board 23 as well as changes the image 
signal to be transmitte d from the image sensing unit -[ a 
from a moving image signal to a still image signa l. Note, 
'after image signals corresponding to one frame of still 
image are outputted, moving image signals are output- 
ted until the shutter button 1 1 is pressed next time. 

Wh en receiving ^ ^application execution request 
signaf^the expansion boara 23 requests tne mother 
board 21 to execute a predetermine d application pro 7 ; 
gram, wnich i s set, in advance, to be executed irT 
response to tne application execution request signal via 

the expansion Slot 22 if the application program is nn t 
r unning currently, in turn, the mother board 21 executes 
the predetermined Application program stored in the 
hard disk 24. After the application program is initiated, 
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an image transmitted from the image sensing unit 13 of 
the image sensing apparatus 101 and dialog between a 
user and the application executed on the computer 201 
are displayed on the display apparatus 30. 

According to the first embodiment as described s 
above, in an image sensing system which processes 
image data, inputted by an image sensing apparatus, 
using a predetermined application executed on a com- 
puter, when the application is notbein g executed, th e 
program is a utomatically initiated bv pressing a shutter 10 
button of the image sensing apparatus without interface 
Inq with the operator. The program is a predetermined 
application program, such as a TV conference applica- 
tion program or a TV phone application program, and is 
set to be executed in response to the operation of the is 
image sensing apparatus. 

( First Modification of the First Embodiment) 

Fig. 2 is a block diagram illustrating a configuration 20 
of an image sensing system according to the first modi- 
fication of the first embodiment of the present invention. 

In the first modification of the first embodiment, the 
configuration of the image sensing system is distin- 
guished from that shown in Fig. 1 by a signal multiplex- 25 
ing unit 14 in the image sensing apparatus 102 and a 
signal separating unit 25 added to the expansion board 
23 in the computer 202. Other units and elements are 
the same as those explained in the first embodiment 
with reference to Fig. 1, therefore, the explanation of 30 
those are omitted. 

Next, an operation of the image sensing system is 
explained. The difference between t he first modificatio n 
of the first embodiment artd t ha first embodiment is that 
arTappircatiorTEreartioM request signal outputted fro m 35 
"the camera controller 12 of the image sensing appara - 
tus 102 to the ex pansion hoard 23 andan image sign al 
outputted from the image sensing unit 13 to the exp an- 
sion board 23 are multip lexed by the signal multiplexing^ 
unif 14, thereafter, transmitted to the expansion board 40 
23 in the first modification of the first embodiment. Fur- 
ther, in the expansion board 23, the newly added signal 
separation unit 25 separates the multiplexed signal into 
the application execution request signal and the image 
signal. The separated signals are independently trans- 45 
mitted from the expansion board 23. 

Out of the separat ed signals, the image signal is 
dispfeyed on the d isplay apparatus au via tne expansio n 
felot22 and the moth erboard 21. Regarding the applica- 
ti on execution request signal, it is transmitted to the 50 
mother board 21 via the expansion slot 22 . When the 
mother board 21 receives the application execution 
request signal, similarly to the first embodiment, it exe- 
cutes a predetermined application program, such as a 
TV conference application program or an image edito- ss 
rial application program, stored in the hard disk 24 when 
the application program is not running, and the display 
30 displays dialog between the user and the application. 



8 

According to the first modification of the first 
embodiment as described above, a signal from the 
camera controller of the image sensing apparatus and 
an image signal from the image sensing unit are multi- 
plexed, and the multiplexed signal is separated in a sep- 
arating unit of the computer. Accordingly, without 
increasing the number of signal lines of a cable con- 
necting between the image sensing apparatus and the 
computer, it is possible to automatically execute a pre- 
determined application program which is set to be exe- 
cuted in response to a pressing operation of the shutter 
button of the image sensing device without interfacing 
with the operator when the application is not being exe- 
cuted. 

< Second Modification of the First Embodiment) 

Fig. 3 is a block diagram illustrating a configuration 
of an image sensing system according to the second 
modification of the first embodiment of the present 
invention. 

In the second modification of the first embodiment, 
the configuration of the image sensing system is distin- 
guished from that shown in Fig. 1 since the expansion 
board 23 and the expansion slot 22 are not provided in 
the computer 203. and a data communication interface 
(l/F) 26 and an image input terminal 27 are mounted on 
the computer 203. The data communication l/F 26 is an 
interface for exchanging data between the camera con- 
troller 12 of the image sensing apparatus 103 and the 
mother board 21 , the main processing unit of the com- 
puter 203. The image input terminal 27 is an interface 
for taking an image signal transmitted from the image 
sensing apparatus 103 to the mother board 21 of the 
computer 203. 

Next, an operation of the image sensing system is 
explained. When the camera controller 12 detects that 
the shutter button 1 1 is pressed, an appliCaliurrexScu- 
tion request signal is transmitt ed to the data communi- 
C5tiorr"tff^g67-^m e" received application execution" 
"request signal is passed to the mother board 21 from 
the data communication l/F 26. When receiving the 
application execution request signal, the mother board 
21 executes a predetermined application program, such 
as a TV conference application program or an image 
editorial program, stored in the hard disk 24. After the 
application program is initiated, an image transmitted 
from the image sensing unit 13 of the image sensing 
apparatus 103 and dialog between the user and the 
application executed on the computer 203 are displayed 
on the display apparatus 30. 

According to the second modification of the firs t 
embodime nt as described aoove, since the data com- 
mu nication l/F and the image input terminal are 
I nstalled in the mother board, it is possible to connect an 
image sensing apparatus and the computer withou t 
us ing an expansion boar ^ for rnnperting between th e 
image sensing apparatus and the computer. Further. 
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when the application is not being executed, a predeter- 
mined application program is automatically initiated by 
pressing the shutter button of the image sensing device 
without interfacing with the operator. 

(Third Modification of the First Embodiment) 

Fig. 4 is a block diagram illustrating a configuration 
of an image sensing system according to the third mod- 
ification of the first embodiment of the present invention. 

I n the third modification of the first embodiment, the 
co nfiguration of the image sensing system is aisttn- 
cjulihed from that shown in Fig. 1 by codecs 15 and 28 
and high-speed communication interlaces (i/h) 16 ana 
2 g^provided in the image sensing apparatus 104 and * 
t he computer 204, respectively. 

' Next, an operation of the image sensing system is 
explained. When the camera controller 12 of the image 
sensing apparatus 104 detects that the shutter button 
1 1 is pressed, an application execution request signal 
from the camera controller 12 and an image signal from 
the image sensing unit 1 3 are encoded by the codec 1 5, 
then transmitted from the high-speed communication 
l/F 16 to the high-speed communication l/F 29 of the 
computer 204. In the computer 204, the codec 29 
decodes the signal received via the high-speed commu- 
nication l/F 29. The decoded application execution 
request signal and the image signal are inputted to the 
mother board 21 . When detecting the application execu- 
tion request signal, the mother board 21 executes a pre- 
determined application program stored in the hard disk 
24. After the application program is initiated, the image 
signal decoded by the codec 28 and dialog between the 
user and the application executed on the computer 204 
are displayed on the display apparatus 30. 

In a case of using a standard high-speed serial 
interface, such as a universal serial bus (USB) interface 
or P1394 interface, by providing USB or P1394 interface 
and a function capable of executing an application to the 
display device 30, it is possible to achieve the same 
advantage as that of the first embodiment by directly 
connecting the image sensing apparatus 104 to the dis- 
play apparatus 30 without the computer 204. 

According to the third modification of the first 
embodiment as described above, an image sensing 
apparatus is connected to a computer via a single cable 
using a high-speed communication interface, and, when 
a predetermined application is not being executed, the 
application program is automatically initiated by press- 
ing the shutter button of the image sensing device with- 
out interfacing with the operator. 

< Other Modifications ) 

In the first embodiment to third modifications of the 
first embodiment, the predetermined application pro- 
gram is stored in the hard disk 24 and, when the mother 
board 21 executes the application program, it accesses 
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the hard disk 24. However, the present invention is not 
limited to this, and the application program may be 
stored in a CD-ROM In such cases, the mother board 
21 accesses the CD-ROM when executing the applica- 
tion. 

Further, the application may be stored in other 
media, such as a floppy disk, a Zip™ floppy disk and 
CD-R, and the mother board 21 accesses respective 
media when executing the application. 

F urther, in a case w here buttons ancl switches, 
su ch as a power switch, a s hutter bultun whioh luo dif- 
ferent operation levels (e.g., half-Stroke and full-Stroke), 
an automatic focusing button, a white balance butto n, 
a nd a zoom button r are provided in the image sens ing 
ajEaffrtns nthPr than the shutter butto n tor sensin g a 
still image, it is possible to add a function for initiating an 
application by operating one of these buttons and 
sw itches, or operating these button s and switches in dif- 
ferent combination s. 

Further, in the first embodiment, when the camera 
controller 12 detects that the shutter button 11 is 
pressed, it transmits an application execution request 
signal to the expansion board 23 as well as switches the 
type of image signal to be outputted from the image 
sensing unit 13 from a moving image signal to a still 
image signal. However, the present invention is not lim- 
ited to^anch^ 

bei ng executed in the computer 201, while keeping 
t^g^ifting a moving image siflnal. thft campra mntrol- 
lar_Jt 2 m a v. tr ans mit the application execution reques t 
sign al to the expansion board 23 to instruct the moth er 
hrjfljrT>1 tn pyecute the application yia the expansion 
slot 22. Accordingly, on the disp lay apparatus 30 a 
moving image sensed by the image sensing unit 13 nf 
t he image sensing appa ra t u s 1 Q1 and riialnn , hpJw een_ 
j he user and the application executed on the compute r 
2 01 are displa yed^ 

e According to the first embodiment to third modifica- 
tions of the first embodiment as described above, by 
operating the image sensing apparatus, a predeter- 
mined application program, such as a TV conference 
application program, an image editorial application pro- 
gram, a TV phone application program, and an OCR 
application program, is automatically initiated. 

Note, in the first embodiment to third modifications 
of the first embodiment, an image sensing apparatuses 
101 to 104, such as a camera, are connected to com- 
puters 201 to 204 to configure an image sensing sys- 
tem, however, the present invention can be applied to 
any data input apparatus, in addition to an image sens- 
ing apparatus, having any trigger means, such as a 
switch button. For example, when a sound input appara- 
tus is connected to the computers 201 to 204, an appli- 
cation for processing sound may be executed in 
response to a predetermined operation of the sound 
input apparatus. In such cases, the data input apparatus 
generates an application execution request signal in 
response to an operation of the trigger means and 
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transmits the signal to the computer; in turn, the compu- 
ter executes a predetermined application which is set to 
be initiated in response to the application execution 
request signal. 

< Second Embodiment) 

Fig. 5 is a block diagram illustrating a configuration 
of an image sensing system according to the second 
embodiment of the present invention, and Fig. 6 is an 
external view of the image sensing system. 

In Fig. 5, reference numeral 100 denotes a camera 
capable of operating in a document mode and a non- 
document mode; 200, a personal computer; 210, a 
CPU; 220, a RAM used for executing an application 
software; 230, a capture board for capturing an image 
sensed by the camera 100; 240, a controller for control- 
ling the capture board 230 and the camera 100; 251 , an 
image file of the captured image; 252, a user interface 
(referred to as "camera application" hereinafter) for con- 
trolling the camera 100 and other necessary units; 253, 
an optical character recognition (OCR) software which 
is frequently used when a document image is captured; 
250, a disk for storing the image file 251 and the appli- 
cation softwares 252 and 253; 300, a user; 400, an 
image signal channel for transmitting an image signal 
from the camera 100; and 500, a control signal channel 
for performing bidirectional communication between the 
camera 100 and the controller 240. In Fig. 5, some 
devices, such as a monitor and a keyboard, which are 
commonly connected to the computer 200 are not 
shown. 

The camera 100 and the personal computer 200 
are arranged as shown in Fig. 6 and connected via a 
cable. 

An operational sequence and a flow of the opera- 
tion of the image sensing system as shown in Fig. 5 are 
explained with reference to Fig. 7. Fig. 7 is an explana- 
tory view showing the operational sequence of switch- 
ing an image sensing mode of the image sensing 
system to the document mode. 

First, the user inputs a request for sensing an 
image in the document mode to the controller 240 [a]. In 
turn, the controller 240 issues a request for setting the 
document mode to the camera 100. Note, the setting of 
the document mode in the camera 100 in the second 
embodiment is instructed by the computer. In response 
to the request, the camera 100 changes image sensing 
operation from an operation suitable for sensing a still or 
moving image, to an operation suitable for sensing a 
document image, thereby changing from the non-docu- 
ment mode to the document mode. Upon changing to 
the document mode, the camera 100 issues a notice 
indicating that the mode is changed to the document 
mode via the control signal channel 500 [c]. This notice 
is inputted to the camera application 252 via the control- 
ler 240. In turn, the camera application 252 down-loads 
the OCR software for processing a document image to 



the RAM 220, and executes the OCR software [d]. 

Thereafter, the user 300 issues a request for cap- 
turing a sensed image, thereby the image is inputted to 
the computer 200 and stored as the image file 251 [e-1 , 

5 e-2]. Note, there are two ways to issue the request for 
capturing an image: by operating the camera applica- 
tion 252 [e-1]; and by pressing a switch provided on the 
camera 100 [e-2]. 

It is possible to make the executed OCR software 

w 253 to automatically start processing on the captured 
document image by reading the image file 251 and rec- 
ognizing characters of the document image. 

Fig. 8 is a block diagram illustrating a configuration 
of the camera 100 which performs monochromatic 

is image processing when sensing an image in the docu- 
ment mode. In Fig. 8, reference numeral 120 denotes 
an image sensing device; 121, an image signal 
processing unit; 122, a micro processing unit (MPU); 
and 123, a driving circuit of the image sensing device 

20 120. When the MPU 122 receives a request for setting 
the document mode via the control signal channel 500, 
it issues a request to perform monochromatic image 
processing to the image signal processing unit 121. 
Accordingly, the camera 100 is set to the document 

25 mode. 

Fig. 9 is a block diagram illustrating another config- 
uration of the camera 100 capable of performing pixel 
shifting operation to obtain a high-resolution image. 
This camera does not perform the pixel shifting opera- 

30 tion in the non-document mode, and performs the pixel 
shifting operation in the document mode. In Rg. 9, ref- 
erence numeral 140 denotes an image sensing device; 
141, an image signal processing unit; 142, an MPU; 
143, a driving circuit of the image sensing device 140; 

35 and 144, a plane parallel plate used in the pixel shifting 
operation. 

When the MPU 142 receives the document mode 
request via the control signal channel 500, it issues a 
request to perform the pixel shifting operation to the 

40 image signal processing unit, the driving circuit 1 43 and 
the plane parallel plate 144. Accordingly, the camera 
100 is set to the pixel shifting mode, i.e., the document 
mode, in this case. 

Note, since the camera 100 can be remote-control - 

45 led in the second embodiment, it is possible to realize 
the image sensing system having a camera and a com- 
puter connected via a network. 

Note, the capture board 230 is not limited to an 
expansion-bus type, and may be replaced by a PC card, 

so or an I/O port capable of receiving an image. Further, 
the controller 240 may be an MPU or application spe- 
cific integrated circuit (ASIC), or may be a device driver 
of the I/O port. Furthermore, the disk 250 may be 
replaced by other recording medium, such as a tape. 

55 Further, the OCR software 253 may be replaced by 
other application program for processing an image. 

According to the second embodiment as described 
above, since the OCR software 253 is automatically ini- 
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tiated when changing the non-document mode to the 
document mode, the OCR process can be effectively 
initiated. 

(Third Embodiment) 5 

In the third embodiment, a case where the process- 
ing of changing from the non-document mode to the 
document mode is performed by directly instructing a 
camera to do so is explained. The configuration of the 10 
image sensing system is the same as that explained in 
the second embodiment with reference to Fig. 5 except 
the configuration of the camera, therefore, the explana- 
tion of it is omitted. 

Fig. 10 is an explanatory view showing an opera- 15 
tional sequence of switching to the document mode. 

First, the user directly inputs a request for sensing 
an image in the document mode to the camera 100 by 
pressing a switch of the camera 1 00 without operating 
the camera application 252 [a], thereby the non-docu- 20 
ment mode is changed to the document mode in the 
camera 1 00. Then, the camera 100 issues a notice indi- 
cating that the mode is changed to the document mode 
via the control signal channel 500 [cj. The notice is 
inputted to the camera application 252 via the controller 25 
240. In turn, the camera application 252 down-loads the 
OCR software for processing a document image to the 
RAM 220, and executes the OCR software [d]. 

Thereafter, the user 300 issues a request for cap- 
turing a sensed image, thereby the image is inputted to 30 
the computer 200 and stored as the image file 251 [e-1 , 
e-2]. Note, there are two ways to issue the request for 
capturing an image: by operating the camera applica- 
tion 252 [e-1]; and by pressing a switch provided on the 
camera 100 [e-2]. 35 

Next, the camera 100 capable of operating in the 
document mode and the non-document mode, used in 
the image sensing system, according to the third 
embodiment is explained. 

Fig. 1 1 is a block diagram illustrating a configuration 40 
of the camera 100 whose head can tift. In this camera, 
when the head of the image sensing device is in upright 
position or tilted upward, it is set to the non-document 
mode, whereas when the head the image sensing 
device is tilted downward, then it is set to the document 45 
mode. In Fig. 11, reference numeral 110 denotes an 
image sensing device; 1 1 1 , an image signal processing 
unit; 112, an MPU; 113, a driving circuit of the image 
sensing device 1 1 1; 1 14, a camera head which can be 
moved in the tilting direction; and 1 1 5, a direction detec- so 
tor. 

The direction detector 115 detects whether the 
image sensing device 111 is in the upright position or 
tilted upward, or tilted downward, and outputs the 
detected result to the MPU 1 12. The MPU 1 12 checks ss 
the detected result of the camera head 1 14, and when it 
determines that the camera head 114 is tilted down- 
ward, it outputs a notice of the document mode via the 




978 A2 14 

control signal channel 500. 

Fig. 12 is a block diagram illustrating another con- 
figuration of the camera 100. In Fig. 12, reference 
numeral 1 30 denotes an image sensing device; 1 3 1 , an 
image signal processing unit; 132, an MPU; 133, a driv- 
ing circuit of the image sensing device 130; and 134 is a 
switch for setting either the non-document mode or the 
document mode. 

In order to switch to the document mode, the user 
300 operates the switch 134. The MPU 132 determines 
the state of the switch 134, and if it determines that the 
switch 134 is set to the document mode, it issues a 
notice of the document mode via the control signal 
channel 500 as well as issues a request for performing 
monochromatic signal processing to the image signal 
processing unit 131. 

According to the third embodiment as described 
above, since the OCR software 253 is automatically ini- 
tiated when the non-document mode is changed to the 
document mode, the OCR processing can be effectively 
initiated. 

Note, in the second and third embodiments, an 
image signal and a control signal are transmitted via dif- 
ferent signal lines, however, the present invention is not 
limited to this, and can be transmitted using a single sig- 
nal line, as shown in the first and third modification of 
the first embodiment, by providing multiplexing and sep- 
aration units or codecs. 

Further, the object of the present invention can be 
also achieved by providing a storage medium storing 
program codes for performing the aforesaid processes 
to a system or an apparatus, reading the program codes 
with a computer (e.g., CPU, MPU) of the system or 
apparatus from the storage medium, then executing the 
program. 

In this case, the program codes read from the stor- 
age medium realize the functions according to the 
embodiments, and the storage medium storing the pro- 
gram codes constitutes the invention. 

Further, the storage medium, such as a floppy disk, 
a hard disk, an optical disk, a magneto-optical disk, CD- 
ROM, CD-R ( a magnetic tape, a non-volatile type mem- 
ory card, and ROM can be used for providing the pro- 
gram codes. 

Furthermore, besides aforesaid functions accord- 
ing to the above embodiments are realized by executing 
the program codes which are read by a computer, the 
present invention includes a case where an OS (operat- 
ing system) or the like working on the computer per- 
forms a part or entire processes in accordance with 
designations of the program codes and realizes func- 
tions according to the above embodiments. 

Furthermore, the present invention also includes a 
case where, after the program codes read from the stor- 
age medium are written in a function expansion card 
which is inserted into the computer or in a memory pro- 
vided in a function expansion unit which is connected to 
the computer, CPU or the like contained in the function. 



8 



15 



EP0 860 978 A2 



16 



expansion card or unit performs a part or entire process 
in accordance with designations of the program codes 
and realizes functions of the above embodiments. 

The present invention is not limited to the above 
embodiments and various changes and modifications 
can be made within the spirit and scope of the present 
invention. Therefore to apprise the public of the scope of 
the present invention, the following claims are made. 

When a shutter button of a camera is pressed, an 
application execution signal is transmitted from the 
camera to a computer which is connected to the cam- 
era. If an application corresponding to the application 
execution signal is not being executed, the computer 
automatically executes the application which is stored in 
a hard disk in response to reception of the application 
execution signal. 

Claims 

1 . An image sensing apparatus capable of connecting 
to an information processing apparatus character- 
ized by comprising: 

operation means (11); 

signal generation means (12) for generating a 
predetermined signal used for requesting to 
execute a predetermined application in the 
information processing apparatus in response 
to an operation of said operation means; and 
communication means (12, 14, 16) for sending 
the predetermined signal generated by said 
signal generation means externally. 

2. The image sensing apparatus according to claim 1 , 
wherein said operation means (11) is a shutter but- 
ton. 

3. The image sensing apparatus according to claim 2 
further comprising: 

image sensing means (13) for sensing an 
object and outputting an image signal; and 
control means (12) for controlling said image 
sensing means so as to output a still image sig- 
nal in response to the operation of the shutter 
button. 

4. The image sensing apparatus according to claim 1 , 
wherein said operation means (11) includes one or 
more buttons or switches. 

5. The image sensing apparatus according to any one 
of claims 1 to 4 further comprising multiplexing 
means (1 4) for multiplexing an image signal and the 
predetermined signal generated by said signal gen- 
eration means (12), 

wherein said communication means (14) 
transmits a multiplexed signal obtained by said mul- 



tiplexing means. 

6. The image sensing apparatus according to any one 
of claims 1 to 4, wherein said communication 

5 means (12) includes: 

means (12) for exchanging control signals 
including the predetermined signal generated 
by said signal generation means (12); and 
w means (13) for transmitting an image signal. 

7. The image sensing apparatus according to any one 
ol claims 1 to 4 further comprising encoding means 
(15) for encoding the predetermined signal gener- 

is ated by said signal generation means (12) and an 
image signal, 

wherein said communication means (16) 
transmits a signal encoded by said encoding 
means. 

20 

8. The image sensing apparatus according to claim 1 
or 7, wherein said communication means (16) is a 
universal serial bus (USB) interface. 

25 9. The image sensing apparatus according to claim 1 
or 7. wherein said communication means (16) is a 
P1394 interface. 

10. A system having an information processing appara- 
30 tus and a data input apparatus, characterized by 

comprising: 

operation means (11); 

signal generation means (12) for generating a 
35 predetermined signal in response to an opera- 

tion of said operation means; 
communication means (12, 14, 16, 23. 26. 27, 
29) for transmitting the predetermined signal 
generated by said signal generation means 
40 from the data input apparatus to the informa- 

tion processing apparatus; and 
control means (21) for automatically executing 
a predetermined application in response to the 
predetermined signal transmitted via said com- 
45 munication means. 

11. The system according to claim 10 further compris- 
ing: 

so multiplexing means (14) for multiplexing a sig- 

nal obtained as a result of operation of the data 
input means and the predetermined signal 
generated by said signal generation means 
(12); and 

55 separation means (25) for separating the pre- 

determined signal from the signal transmitted 
via said communication means (14), 

wherein said communication means 
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(14) transmits a multiplexed signal obtained by 
said multiplexing means. 

12. The system according to claim 10, wherein said 
communication means (12, 23, 26, 27) includes: 

means (12, 26) for exchanging control signals 
including the predetermined signal; and 
means (13, 23, 27) for transmitting a signal 
obtained as a result of operation of the data 
input apparatus. 

13. The system according to claim 10 further compris- 
ing: 

encoding means (15) for encoding the prede- 
termined signal generated by said signal gen- 
eration means (12) and a signal obtained as a 
result of operation of the data input apparatus; 
and 

decoding means (28) for decoding a signal 
transmitted via said communication means (16, 
29), 

wherein said communication means 
transmits a signal encoded by said encoding 
means. 

14. The system according to claim 10 or 13. wherein 
communication means (16, 29) is a universal serial 
bus (USB) interface. 

15. The system according to claim 10 or 13, wheran 
said communication means (16, 29) is a P1394 
interface. 

1 6. The system according to any one of claims 1 0 to 1 5 
further comprising storage means (24), which can 
be read by the information processing apparatus, 
for storing the predetermined application. 

1 7. The system according to any one of claims 1 0 to 1 5 
further comprising a display apparatus (30) for dis- 
playing an image on the basis of data inputted by 
the data input apparatus and dialog of the predeter- 
mined application. 

18. The system according to any one of claims 10 to 
15, wherein the data input apparatus is an image 
sensing apparatus. 

19. The system according to claim 18, wherein said 
operation means (1 1) is a shutter button. 

20. The system according to claim 19 further compris- 
ing: 

image sensing means (13) for sensing an 
object and outputting an image signal; and 



control means (12) for controlling said image 
sensing means so as to output a still image sig- 
nal in response to the operation of the shutter 
button. 

5 

21. The system according to claim 18, wherein said 
operation means (1 1) includes one or more buttons 
or switches. 

io 22. The system according to claim 18, wherein the sig- 
nal obtained as a result of operation of the data 
input apparatus is an image signal. 

23. A method for controlling an information processing 
is apparatus capable of connecting to an external 

data input apparatus, characterized by comprising: 

a receiving step of receiving a signal from the 
external data input apparatus; and 
20 a control step of executing a predetermined 

application when a predetermined signal is 
received in said receiving step. 

24. The method according to claim 23 further compris- 
es ing a step of separating a predetermined signal 

from the signal received in said receiving step. 

25. TTie method according to claim 23, wherein, in said 
receiving step, control signals including the prede- 

30 termined signal and a signal obtained as a result of 
operation of the external data input apparatus are 
received via different communication lines. 

26. The method according to claim 23 further compris- 
35 ing a step of decoding the signal received in said 

receiving step. 

27. A method for controlling a system having an infor- 
mation processing apparatus and a data input 

40 apparatus, characterized by comprising: 

a detecting step of detecting a predetermined 
operation in the data input apparatus; 
a generating step of generating a predeter- 
45 mined signal used for requesting to execute a 

predetermined application in the information 
processing apparatus when the predetermined 
operation is detected in said detecting step; 
a communication step of transmitting a prede- 
so termined signal from the data input apparatus 

to the information processing apparatus; and 
a control step of executing a predetermined 
application in the information processing appa- 
ratus on the basis of the predetermined signal 
55 transmitted in said communication step. 

28. The method according to daim 27 further compris- 
ing: 
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a multiplexing step of multiplexing a signal 
obtained as a result of operation of the data 
input means and the predetermined signal 
generated in said generating step; and 
a separation step of separating the predeter- 
mined signal from the signal transmitted in said 
communication step, 

wherein, in said communication step, a 
multiplexed signal obtained in said multiplexing 
step is transmitted. 

29. The method according to claim 27, wherein, in said 
communication step, control signals including the 
predetermined signal and a signal obtained as a 
result of operation of the data input apparatus are 
transmitted via different communication lines. 

30. The method according to claim 27 further compris- 
ing: 

an encoding step of encoding the predeter- 
mined signal generated in said generating step 
and a signal obtained as a result of operation of 
the data input apparatus; and 
a decoding step of decoding a signal transmit- 
ted in said communication step, 

wherein, in said communication step, 
the signal encoded in said encoding step is 
transmitted. 

31. The method according to any one of claims 27 to 
30, wherein the data input apparatus is an image 
sensing apparatus. 

32. The method according to claim 27 further compris- 
ing an image sensing step of sensing an object and 
outputting an image signal, 

wherein, when the predetermined operation 
is detected in said detecting step, a still image sig- 
nal is outputted in said image sensing step. 

33. The system according to claim 31 , wherein the sig- 
nal obtained as a result of operation of the data 
input apparatus is an image signal. 

34. The method according to any one of claims 27 to 33 
further comprising a display step of displaying an 
image on the basis of data inputted by the data 
input apparatus and dialog of the predetermined 
application. 

35. A computer program product comprising a compu- 
ter usable medium having computer readable pro- 
gram code means embodied in said medium for 
controlling an information processing apparatus 
capable of connecting to an external data input 
apparatus, said product including: 



first computer readable program code means 
for receiving a signal from the external data 
input apparatus; and 

second computer readable program code 
5 means for executing a predetermined applica- 

tion when a predetermined signal is received 
by said first computer readable program code 
means. 

10 36. The computer program product according to claim 
35 further comprising third computer readable pro- 
gram code means for separating a predetermined 
signal from the signal received by said first compu- 
ter readable program code means. 

15 

37. The computer program product according to claim 
35 further comprising fourth computer readable 
program code means for decoding the signal 
received by said first computer readable program 

20 code means. 

38. An image sensing apparatus capable of operating 
in a plurality of operational modes and connecting 
to an information processing apparatus, character- 

25 ized by comprising: 

signal generation means (112, 122, 132. 142) 
for generating a predetermined signal indicat- 
ing that the image sensing apparatus starts 
30 operating in a predetermined mode; and 

communication means (500) for sending the 
predetermined signal generated by said signal 
generation means externally. 

35 39. A system having an information processing appara- 
tus and a data input apparatus capable of operating 
in a plurality of operational modes, characterized by 
comprising: 

40 control means (252) for automatically execut- 

ing a predetermined application corresponding 
to a predetermined operational mode out of the 
plurality of operational modes when the data 
input apparatus starts operating in the prede- 

45 termined operational mode. 

40. The system according to claim 39 further compris- 
ing: 

so signal generation means (112, 122, 132, 142) 

for generating a predetermined signal indicat- 
ing that the data input apparatus starts operat- 
ing in a predetermined mode; 
communication means (500) for transmitting 

55 the predetermined signal generated by said 

signal generation means to the information 
processing apparatus. 
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41. The system according to claim 39, wherein the 
information processing apparatus instructs the data 
input apparatus to start operating in the predeter- 
mined mode. 

42. The system according to claim 39, wherein the pre- 
determined mode is a document mode, and when 
the data input apparatus starts operating in the doc- 
ument mode, said control means (252) automati- 
cally executes an application for processing an 
image file of a document image. 

43. The system according to claim 42, wherein said 
control means (252) controls the application to 
automatically read an image file obtained in the 
document mode. 

44. A method for controlling an information processing 
apparatus capable of connecting to an external 
data input apparatus capable of operating in a plu- 
rality of operational modes, characterized by com- 
prising: 

a control step ([d]) of automatically executing a 
predetermined application corresponding to a 
predetermined operational mode out of the plu- 
rality of operational modes when the external 
data input apparatus starts operating in the 
predetermined operational mode. 

45. The method according to claim 44 further compris- 
ing a receiving step ([c]) of receiving a predeter- 
mined signal indicating that the external data input 
apparatus starts operating in a predetermined 
mode from the external data input apparatus. 

46. A method for controlling a system having an infor- 
mation processing apparatus and a data input 
apparatus capable of operating in a plurality of 
operational modes, characterized by comprising: 

a control step ([d]) of automatically executing a 
predetermined application corresponding to a 
predetermined operational mode out of the plu- 
rality of operational modes when the data input 
apparatus starts operating in the predeter- 
mined operational mode. 

47. The method according to claim 46 further compris- 
ing: 

a signal generation step of generating a prede- 
termined signal indicating that the data input 
apparatus starts operating in a predetermined 
mode; and 

a communication step ([c]) of transmitting the 
predetermined signal generated in said signal 
generation step to the information processing 



apparatus. 

48. The method according to claim 44 or 46 further 
comprising a step ([a], [b]) of instructing the data 

5 input apparatus to start operating in the predeter- 
mined mode. 

49. The method according to claim 44 or 46, wherein 
the predetermined mode is a document mode, and 

10 when the data input apparatus starts operating in 
the document mode, in said control step ([d]), an 
application for processing an image file of a docu- 
ment image is executed. 

75 50. Tine method according to claim 49, wherein, in said 
control step ([d]), an image file obtained in the doc- 
ument mode is automatically read by the applica- 
tion. 

20 51. A computer program product comprising a compu- 
ter usable medium having computer readable pro- 
gram code means embodied in medium for 
controlling an information processing apparatus 
capable of connecting to an external data input 

25 apparatus capable of operating in a plurality of 
operational modes, said product including: 



first computer readable program code means 
for automatically executing a predetermined 
application corresponding to a predetermined 
operational model out of the plurality of opera- 
tional modes when the external data input 
apparatus starts operating in the predeter- 
mined operational mode. 
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52. The computer program product according to claim 
51 further comprising: 

second computer readable program code 
means for receiving a predetermined signal 
indicating that the external data input appara- 
tus starts operating in a predetermined mode 
from the external data input apparatus. 

53. The computer program product according to claim 
51 further comprising third computer readable pro- 
gram code means for instructing the external data 
input apparatus to start operating in the predeter- 
mined mode. 

54. The computer program product according to claim 
51, wherein the predetermined mode is a document 
mode, and when the external data input apparatus 
starts operating in the document mode, said first 
computer readable program code means ([d]) exe- 
cutes an application for processing an image file of 
a document image. 
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55. The computer program product according to claim 
54 further comprising fourth computer readable 
program code means for controlling the application 
to automatically start reading an image file obtained 
in the document mode. s 
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